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Abstract 



Moment-closure approximations are an important tool in the analysis of the dynamics on both static and adaptive networks. Here, 
C^l " ,we Provide a broad survey over different approximation schemes by applying each of them to the adaptive voter model. While 
already the simplest schemes provide reasonable qualitative results, even very complex and sophisticated approximations fail to 
capture the dynamics quantitatively. We then perform a detailed analysis that identifies the emergence of specific correlations as the 
reason for the failure of established approaches, before presenting a simple approximation scheme that works best in the parameter 
range where all other approaches fail. By combining a focused review of published results with new analysis and illustrations, we 
seek to build up an intuition regarding the situations when existing approaches work, when they fail, and how new approaches can 
be tailored to specific problems. 
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1. INTRODUCTION 

Complex networks have been ubiquitously used to model 
problems from various disciplines yj-|6[]. Treating a complex 
system as a network, a set of discrete nodes and links, leads to 
a conceptual simplification that often allows subsequent analyt- 
ical insight that provides a deep understanding. 

For many questions the networks of interest are not static 
entities but change in time due to the dynamics of and on the 
network. In the dynamics of networks, the network itself is 
regarded as a dynamical system. Prominent examples are net- 
work growth models leading to specific topologies such as scale- 
free 17[] and small-world networks 180 . The dynamics on net- 
works concerns dynamical processes such as epidemic spread- 
ing |@1 that occur on a given fixed network, where each node 
carries a state which evolves through interactions with its neigh- 
bors. 

If the dynamics on and of networks occur simultaneously 
and interdependently then the network topology coevolves with 
the states of the nodes and an adaptive network is formed |10„ 
1 111 . Adaptive networks have been used to model problems of 
opinion formation jl2l - 1 811. ep idemic spreading [1 19 142711 . evo- 
lution of cooperation 128144011 . synchronization 141144511 . neu- 
ronal activi ty 1 461 -541. collective motion |55ll56Tl . carte lisation 
of markets 15 711 . and particle diffusion |581 among others. 

Network models in general and adaptive networks in partic- 
ular provide a powerful framework to model, analyze, and even- 
tually understand a wide range of self-organization phenomena. 
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For instance Tomita et al. 159H showed that a very simple adap- 
tive network model can be used to produce a huge variety of 
different self-organizing structures including a self-replicating 
Turing machine. 

While specific models can be studied by agent-based sim- 
ulation, the numerical performance scales badly with the com- 
plexity of update rules in the model, which makes exploration 
of a wider range of models difficult. In particular those models 
where the update of the state or neighborhood of nodes depends 
on the states of multiple other neighboring nodes pose strong 
numerical demands. Additionally the general bad data local- 
ity of network simulations precludes efficient parallelization. 
This defines a strong need for analytical approaches, and, based 
on recent successes, highlights the exploration of dynamic net- 
works with complex update rules as an area where analytical 
work could outpace and guide numerical exploration. 

A direct microscopic description of dynamical networks gen- 
erally constitutes a very high-dimensional dynamical system. 
While in some cases exact analytical results were nevertheless 
obtained (e.g. 135 16111 ). there are presently no approaches 
that are generally applicable. Much of the theoretical progress 
therefore relies on the derivation of reasonably low-dimensional 
coarse-grained approximations to the full microscopic model. 

For networks in which the node can only assume states from 
a (small) discrete set of possibilities, approximation schemes 
are well established. These schemes are deeply rooted in physics 
and can be traced back to early work on the Ising model l62l 



6311 . In the networks literature there is presently a veritable zoo 



of different approximation schemes that build on similar princi- 
ples but take different information into account. In the follow- 
ing we refer to these approaches as moment-closure approxima- 
tions. The common idea in all of these approaches is to derive 
evolution equations for the abundance of certain subgraphs in 
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the network. One starts with writing an evolution equation for 
small subgraphs, such as single nodes, before writing equations 
for larger motifs - a process that is reminiscent of classical mo- 
ment expansions. The system of equations that is thus obtained 
generally depends on the abundance of other, typically larger, 
subgraphs that are not captured, and thus needs to be closed 
by estimating the abundance of these subgraphs - the actual 
moment-closure approximation. 

Despite their underlying similarity moment-closure approx- 
imations proposed in the recent literature differ widely by the 
type and number of the subgraphs they capture. Generally speak- 
ing, capturing the dynamics of more subgraphs, leads to better 
approximations at the cost of having to deal with a larger sys- 



tem of equations (see 115l |23l 16446711 ). In practice some re- 



cently proposed schemes are successfully applied which only 
capture one or two subgraphs, while others capture thousands 
or millions of subgraphs. 

For the analysis of adaptive networks, but also certain types 
of dynamics on static networks, moment-closure approxima- 
tions are presently the most commonly applied theoretical tool. 
In adaptive networks t hey were used for instance to study epi- 
demics ll~9l|24l [26j I27IJ68 j7^l_collective motion JHEl], evo- 
lution of cooperation and social opinion formation 

Despite the abundance of examples there is so far little in- 
tuition on when particular approximation schemes work and 
when they fail. This is most notable when conside ring the adap- 
tive SIS model | and the adaptive voter model Il3l4l5ll . Both 
of these models are adaptive network models of similar com- 
plexity, and, depending on personal taste, either can be con- 
sidered as the most simple non-trivial adaptive network. How- 
ever, for the adaptive SIS model, the dynamics can be faithfully 
captured already by simple approximation schemes with 
more sophisticated approaches leading expectedly to a further 
improvement! 23l 70i 71]. By contrast, for the adaptive voter 
model, simple a ppro ximation schemes only provide unsatisfac- 
tory results Il3[ll5ll and, as we show here, more sophisticated 
approaches can actually perform worse. 

In the present paper, we aim to offer an in-depth analy- 
sis of the performance and the failure of different approxima- 
tion schemes. For the purpose of illustration we focus on the 
adaptive voter model as it provides a mathematically simple, 
yet challenging example system. To this system we apply the 
major approximation schemes proposed in the recent literature. 
Thereby, we build up an intuition of the advantages and disad- 
vantages of the respective schemes. 

A second goal of the present paper is to provide researchers 
entering the field with "worked examples" for the major ap- 
proximation schemes. We present these examples in strongly 
abbreviated form in the main text, while providing all calcula- 
tions in full detail in the appendices. 

The paper is structured as follows: We start in Sec. [2] by 
introducing the adaptive voter model. In Sec. [3] we study the 
so-called homogeneous approximations, which result in rela- 
tively low dimensional equation systems. For these we explore 
in particular the effect of the order of approximation. Then, 
in Sec. [4] we discuss different heterogeneous approximations, 



which yield high-dimensional equation systems, but surpris- 
ingly do not significantly improve the performance of the ap- 
proximation. Finally, in Sec. [5] we introduce a slightly differ- 
ent expansion that captures very similar information but works 
exactly in those parameter ranges where other approximations 
fail. A summary and discussion in Sec.|6]concludes the paper. 

2. ADAPTIVE VOTER MODEL 

The voter model considers the competition of equally at- 
tractive and mutually exclusive opinions (say A and B) in a 
population of interacting agents. The agents are represented 
by nodes that have an internal binary state variable, indicating 
the opinion held by the corresponding agents. The state is up- 
dated dynamically in time due to social interactions, occurring 
between linked agents. 



In the original non-adaptive voter model [77] the underlying 
interaction topology is static. At each time step, a pair of nodes 
connected by a link is selected. If they share the same state, 
nothing happens. Otherwise, one of the two adopts the other's 
state. This model has been explored in many subsequent works 
and in particular the dependence of the time needed to reach 
consensus on the underl ying to pology and details of the update 
rule is well understood l7£ 
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Figure 1: (Color online) Parabola of active states. Shown are five representative 
trajectories for each of three parameter values and three different update rules. 
The long-term behavior depends on the value of the rewiring rate p. If this 
rate exceeds a threshold p* then the system quickly approaches a fragmented 
state in which the number of active links [AB] vanishes, while the density of a 
given opinion (say, [A]) remains almost constant. If p is below the threshold 
rewiring rate then the model approaches a parabola of meta-stable active states 
on which it remains for a long time while undergoing a random walk in the 
opinion density that eventually leads to consensus. Parameters: N = UP and 
(k) = 4. 



The adaptive variants of the model II 1 21 - 4 1 511 additionally in- 
corporates a phenomenon known as social segregation, the ten- 
dency of humans to link preferentially to others holding similar 
opinions and distance themselves from those holding opposite 
opinions. Starting from a suitable initial condition, a pair of 
nodes connected by a link is selected at each time step. If the 
link is inert, connecting nodes in the same state, then nothing 



happens. Otherwise, the link is active and either (with proba- 
bility p) one of the nodes rewires the link by detaching it from 
the other node and attaching to a random node that shares its 
opinion, or one of the nodes copies the other node's state. 

In the spirit of discrete event simulations, using the Gille- 
spie algorithm, the probability p can be thought of as an effec- 
tive parameter capturing the rate of rewiring events, normalized 
by the total rate of update events happening in the network. We 
therefore call p the rewirin g rat e. 



Previous investigations [ 12- 15, 87] have shown that there is 
a critical rewiring rate, p* , at which the behavior of the model 
changes qualitatively. If p > p* then the system quickly ap- 
proaches a fragmented state in which the network splits into 
two disconnected components that hold opinion A and B, re- 
spectively. Since no active links survive the dynamics freezes 
in this fragmented state. By contrast, if p < p* then the sys- 
tem remains active for a long time before eventually reaching a 
complete consensus on one of the opinions, which is likewise 
an absorbing state (see Fig.Q]). 

We note many variants of the adaptive voter model using 
different update rules have been investigated in the literature 
1 12Ul6. 75l I88l493ll . Apart from models with more than two 
states I U 18, 94] and models with directed links] 16], the most 
prominent difference is the precise procedure for selecting the 
link that is updated and the direction of the update (e.g. which 
node adopts the others opinion) on this link. One distinguishes 
between direct node update, reverse node update, and link up- 
date rules. In the two node update rules, one selects a random 
node (node X) then a random neighbor (node Y). Selecting the 
nodes in this way creates a slight bias in the selected nodes re- 
garding the degree, i.e. the number of neighbors of the respec- 
tive nodes. Essentially, a node of higher degree has a propor- 
tionally higher probability of being found by following a link, 
and conversely the nodes found in this way have a higher de- 
gree. Therefore, the average degree of node Y is higher than 
the average degree of node X yj] . In models using direct node 
update, X retains the link in rewiring events and adopts Y's state 
in update events, whereas in models using reverse node update 
Y retains the link in rewiring events and copies X's opinion 
in update events. By contrast, in the link update rule one ran- 
domly selects a link, such that both selected nodes have identi- 
cal statistical properties. While the precise update rule can have 
a significant impact on convergence times 11411 . the qualitative 
features of the models, described above remain unchanged (see 
Fig. ID- 

In the remainder of this paper we apply different moment- 
closure approximations for capturing the dynamics of the voter 
model. Specifically, we compare the ability of the different ap- 
proaches to predict the density of active links in the state when 
both opinions are equally abundant. 

The specific model that we consider throughout most of 
the paper is as follows: We start with an Erdos-Renyi ran- 
dom graph with N nodes and L links, such that the mean de- 
gree is (k) = 2L/N. Initial opinions are assigned randomly 
with equal probability. Therefore, the initial abundances obey 
Na = Nb = N/2. The network is then evolved by a link up- 
date rule: At each time step an active link is selected at random. 



With probability p one of the nodes rewires the link and con- 
nects to a random node of same state. Otherwise, that is with the 
complementary probability 1 - p, one of the nodes adopts the 
other's state. The respective node that retains the link or adopts 
the other's opinion is selected randomly with equal probabil- 
ity. The model is simulated according to these rules until either 
fragmentation occurs or an active state is reached where the 
density of active links remains approximately constant over an 
intermediate time scale. 

3. HOMOGENEOUS APPROXIMATIONS 

For classifying the different approximation schemes that have 
been proposed, it is useful to distinguish between homogeneous 
and heterogeneous approximations. While all approximations 
attempt to capture the dynamics of certain subgraphs, they dif- 
fer in the way in which subgrap hs are identified: Homogeneous 
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graphs according to states of the nodes and the internal topology 
in the subgraph, whereas heterogeneous approximations addi- 
tionally take the de gree of the node s in the subgraph into ac- 
count lr9l[HEll7^MI^I%UlO0ll. 

Homogeneous moment-closure approximations have been 
used in the past tw o decades to explain dynamics on static net- 



works 11641 165L I95L llOll 1 10211 and have more recently been ap- 
plied to adaptive models of epidemic spreading 
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,1731,1741], and collective motion |55, 5611 . 
The central idea of homogeneous approximations is to cap- 
ture the dynamics of the network by writing balance equations 
for the density or abundance of a certain set of labeled sub- 
graphs (motifs), which are called network moments. The sys- 
tem of differential equations of network moments constitutes 
the moment expansion which is then closed by the so-called 
moment-closure approximation. 

3.1. Moment Expansion 

Writing the rate equation for a network moment necessitates 
calculating the rates of all possible processes that result in ei- 
ther the formation or destruction of the respective subgraph. For 
the adaptive voter model, the moment expansion for small sub- 
graphs (nodes and links) has already been developed in Vazquez 
et al. 11311 and independently for an identical model by Kimura 
and Hayakawa 11511 : 



dT [AA] 



0, 



l -[AB] + ( J—El(2[ABA] - [AAB]), 
l -[AB] + ( l^El(2[BAB] - [ABB]), (1) 



where [X] denotes the density of nodes with state X, [XY] de- 
notes the density of links between nodes of state X and Y, and 
[XYZ] denotes the density of triplets constituted by a node of 
state Y in the center and its two neighbors of state X and Z, with 
X, Y, Z e {A,B}. The densities are normalized with respect to 
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the number of nodes N, i.e. [Q.] - Nn/N where we used Q, 
as a placeholder for an arbitrary subgraph (e.g. A-node, AB- 
link, AAB-triplet), such that Nn is the total abundance of that 
subgraph in the network. 

The first equation in Eq. ([TJ states that the density of nodes 
of state A (and equivalently B) is conserved in the thermody- 
namic limit. This is peculiar to the voter model and is a di- 
rect consequence of symmetry in state adoption. In an update 
step, the A-node adopts state B with probability (1 - p)/2 and 
equivalently the B-node adopts state A with the same probabil- 
ity (1 - p)/2 leading to a vanishing net drift in the deterministic 
limit. 

The second equation captures the change in the density of 
AA-links [AA]. If a B-node adopts state A on an AB-link (at 
rate (1 - p)[AB]/2) or an A-node rewires an AB-link and forms 
a link to another A-node (at rate p[AB]/2), an AA-link is di- 
rectly created in the update. The total rate of this direct creation 
of AA-Links is thus [AB]/2. Additionally, AA-links can be cre- 
ated indirectly. Consider a B-node that is connected to two A- 
neighbors such that the three nodes form an ABA-triplet. When 
this B-node adopts state A, instead of one, two AA-links are 
formed. While the rate of adoption events creating A-nodes is 
(1 -p)[AB]/2 the expected additional links created indirectly in 
such adoption events are 2[ABA]/[AB]. Thus the total rate for 
the indirect creation of AA-links is (1 - p)[ABA]. Finally, AA- 
links can be destroyed indirectly if one of the A-nodes forming 
an AA-link adopts state B due to an interaction with another B- 
node, which happens at rate (1 - p)[AAB]/2. The rate equation 
for [BB] is obtained by interchanging A and B in the second 
equation. 

The system of equations ([TJ is not closed as it contains the 
(unknown) densities of larger subgraphs. This is a general prop- 
erty of moment expansions. For a system where the update 
rules directly affect subgraphs of diameter d (here, 1) the evo- 
lution equation for a subgraph of diameter / generally contains 
subgraphs of diameter up to d + I due to indirect effects. 

For a more precise discussion it is useful to define the order 
of a network moment as the number of links contained in the 
corresponding subgraph. For instance, the moments [X], [XY] 
and [XYZ] have order zero, one and two respectively. Accord- 
ingly, one can define the order of a network model as the largest 
order of subgraphs used in definition of the network update pro- 
cess, e.g. the voter model has order one since it involves a link 
at most in the definition. 

Let us denote the model order as om, the set of node states 
as S (S = \A,B) in the voter model), and the set of network 
moments of order o as [Q„], e.g. [Qo] = {[X] : X e S], [£2i] = 
{[XY] :X,Y eS], and [Q 2 ] = {[XYZ] :X,Y,ZeS}. Then, 



^[^] = /^([no],[Oi], 



.[<W) = 



(2) 



where [cj ] e [Q c ] and f a is a R-valued function that is mo- 
ment specific. 

We note that there are variants of moment expansions that 
differ in the definition of the set Q, . One intuitive approach 
is to include all possible subgraphs that contain o links. How- 
ever, more appropriate basis of subgraphs can be constructed by 



considering the specific properties of the model. For instance, 
sparse random graphs tend to be locally tree-like. If a model 
does not have any particular update rules that actively create 
small cycles, cyclic motifs are exceedingly rare and can thus in 
general be safely ignored. 
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Figure 2: (Color online) Validity of the moment expansion. The quasi- 
stationary density [AB] at [A] = [B] = 1/2 from agent-based simulations 
is compared with [AB] computed analytically from the moment expansion 
(Eq. (3) for link and reverse node update ^Appendix D) , and see |Appendix E| 
for direct node update). In this plot, the moment-closure approximation is 
avoided and the analytical results use the triplet densities [AAfi] and [ABA] 
measured in the numerical simulation. Parameters: N = 10 s , (k) = 4. 

In order to test the validity of the moment expansion Eq. ([JJ) 
for the adaptive voter model, we solve for the density [AB] in 
the same equation at the steady state, which yields 



[AB] = (1 - p)([AAB] - 2[ABA]). 



(3) 



To assess the validity of the expansion independently of the sub- 
sequent closure approximation we compute the expected num- 
ber of active links for the respective triplet densities [AAB] and 
[ABA] observed in an agent-based simulation. The resulting 
diagram, Fig. [2] shows an almost perfect match for the active 
link density [AB] with the numerical results for the model with 
link update. The match for node update rules is less good, in 
particular for low rewiring rates, but becomes better as we ap- 
proach the transition point where the active links vanish and the 
network fragments. 

Let us discuss the bad performance of the expansion for the 
node update rules in a little more detail. The moment expansion 
can only be exactly valid in the thermodynamic limit. However, 
the link update model shows that for the network sizes consid- 
ered here finite size effects can be neglected. The only other 
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explanation is that the simulated system contains some corre- 
lations that are not picked up by the moment expansion. Be- 
cause the effect of long-ranged correlations should have been 
captured. However, in the expansion we are implicitly assum- 
ing that the triplets are statistically distributed within the net- 
work, which is approximately true for the link update rule at 
low rewiring rates. By contrast in the node update rules the bias 
can induce additional correlations. This effect is counteracted 
by the rewiring as this mixes the network and thus improves the 
prediction. 

As a side-note, let us remark that the beneficial effect of 
rewiring is a general property. In a given static network model 
a specific topological feature, such as a node of particular high 
degree or a densely clustered region, might exist that biases the 
system constantly in a specific direction. In an adaptive network 
such topological features may emerge for a limited time before 
being destroyed by topological dynamics. In the long run the 
effect of unlikely local configurations often averages out. In 
this sense adaptive networks are ensembles of themselves and 
can thus often be very well approximated unless correlations 
arise systematically that are not captured by the approximation 
scheme used. 

3.2. Moment -Closure Approximation 

In the previous section we have seen that moment expan- 
sions lead to an infinite hierarchy of equations. So far we trun- 
cated this expansion after the first order and used numerical val- 
ues for the densities of larger subgraphs. Because we generally 
develop the expansion to obtain an analytical solution, we can- 
not rely on numerics, but must estimate the density of large 
subgraphs using a suitable approximation, known as moment- 
closure approximations. 

For illustration let us approximate the second order moment 
[ABA] in terms of the zeroth order moment [B] and the first 
order moment [AB] by the so-called pair approximation. An 
ABA-triplet comprises two adjacent AB-links sharing a com- 
mon B-node. Therefore we first note that the density of single 
AB-links is [AB]. Next, we compute the probability that an 
additional A-node is connected to the B-node in this link. 

Since we reached the B-node by following a link, we can 
expect it to have a higher-than-average degree. Specifically, the 
degree of the B-node in a randomly selected AB-link follows 
the distribution Qf = kP B k /([B](k B )), where P B denotes the 
probability that a randomly selected B-node has degree k and 
(kg) is the mean degree of a randomly selected B-node. The 
expected number of additional links of a B-node in an AB-link 
is thus (qs) = (k - > which is also known as the mean 
excess degree |2[] (of B-nodes). 

A key assumption that we have to make at this point is that 
the AB-links are uncorrected, except for the effect of the node 
degree described above. Using this assumption, each of the 
additional links of the B-node is an AB-link with probability 
[AB]/([AB] + 2[BB]). Using [AB] + 2[BB] = (k B )[B], we find 



2[ABA] * k b 



[AB] 2 
[B] 



(4) 



Similarly, 

2[BB][AB] 2[BB] 2 
[ABB] k b and [BBB] k b - 



[B] 



[B] 



(5) 
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Figure 3: (Color online) Performance of the first and second-order homoge- 
neous moment-closure approximations. As a function of the rewiring rate p, 
the density of active links [AB] from agent-based simulations is compared 
with results of the pair approximation, and two different triplet approximations 
[(A) - BAA] = 0.5[AAA][AAB]/[AA] and [(A) - BAA] = 0.5[AAB] 2 /[AB] 
(dashed, dash-dotted, respectively). Parameters: N = 10 5 , (k) = 4. 

The parameter k b that appears in these equations is gen- 
erally not known because the degree distribution is reshaped 
by the rewiring process (although see |fl6j| for an exception). 
Governing Kb are two counteracting effects, on the one hand 
we know that the degree of a node that is reached via a link 
is on average greater than the mean degree and on the other 
hand we have to subtract 1 from this increased degree, because 
we are only interested in the number of additional links. On 
Erdos-Renyi random graphs, these effects cancel exactly such 
that k b — 1 . Although the value of Kb can be significantly higher 
in networks with broad degree distributions, assuming Kb — 1 
has yielded goo d results for models with a fairly wide degree 
distribution Jl9tl . 

Substituting Eqs. (|4][5]) into Eq. ([1) and using the random- 
graph approximation Kb — 1 yields 

> - »• 



dt 



[BB] 



l rAm V-P) (IAB] 2 2[BB][AB] \ 
2^ + — [*]— ■ 



(6) 



where k b = (qB)/(k B )- 



In order to test the performance of approximation we solve 
Eq. (O for the stationary density of active links 

[Afi]= r ( i-D [Ai(i " iAi) ' (7) 



which nicely captures the parabola shape of the states, shown in 
Fig. Q] Furthermore, considering the tip of the parabola [A] = 
1 /2, we find 

'<*>(! -J0-1' 



[AB] 



(8) 



4(1 -p) 

A comparison of the Eq. © with numerical results is shown 
in Fig. [3] The comparison shows that the approximation cap- 
tures qualitative features of the model. The highest density of 
active links is found for p — 0, then as p is increased the den- 
sity of active links declines and finally reaches zero at a finite 
rewiring rate p*. However, the quantitative correspondence be- 
tween the analytical and numerical results is very bad. In par- 
ticular the pair approximation significantly overestimates the 
rewiring rate at which fragmentation occurs. 
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Figure 4: (Color online) Validity of the random-graph approximation. Com- 
parison of the degree distribution of B-nodes, P?, in agent-based simulations 
with a Poisson distribution = e~w (k) k /k\. The comparison shows that the 
degree distribution of the adaptive network remains almost exactly Poissonian, 
and hence the random-graph approximation is valid to very good approxima- 
tion. Parameters: N = 10 5 , (k) = 4. 

Let us investigate the reason of the bad performance of the 
approximation in more detail. We have already argued above 
that the random-graph approximation Kb — 1 is probably harm- 
less. This can be confirmed by comparing the degree distribu- 
tion observed in simulations to the Poissonian distribution of 
a random graph (Fig. 3J. The comparison shows that the de- 
gree distribution stays very close to the Poissonian distribution. 
For such a close match the random-graph approximation is al- 
most exact and cannot be the source of the major discrepancy 
observed in the results. 

Accepting the validity of the moment expansion and rul- 
ing out the random-graph approximation as a source of errors 
leaves us with only two further sources of errors: We have as- 
sumed that a) the actual density of large motifs can be replaced 
with its expectation value and b) that correlations between ac- 
tive links can be neglected when computing this expectation 
value. 



Let us first consider assumption a), which we call truncation 
assumption. Approximating any system by a lower-dimensional 
system is only possible if there is a time scale separation be- 
tween slow low-order moments and fast higher-order moments 
l68ll . The system then quickly converges to the slow mani- 
fold, characterized by the slow variables only II 1 0411 . There- 
fore, dynamics of moments higher than some order are enslaved 
to the dynamics of lower ones and they can be expressed as 
algebraic functions of low order slow moments. In our mo- 
ment expansion the higher-order moments are disproportion- 
ately more likely to be affected by updates. For instance a sin- 
gle rewiring event effects one link, but approximately 2(kb(Ic)) 2 
triplets. While a more detailed investigation of this point would 
probably be fruitful, we conclude that assumption a) is proba- 
bly not the main source of error in the present approximation 
scheme. 




Figure 5: (Color online) Test of the pair approximation. Shown is the ratio 
between the observed number of triplets in agent-based simulations and the ex- 
pected number based on the observed number of nodes and links. The pair 
approximation is approximately valid for ABB triplets, whereas the error in the 
approximation of ABA triplets diverges as the system approaches the fragmen- 
tation point p* . The sketch in the inset explains this failure. Close to fragmen- 
tation many active links are created by very few nodes that are in the wrong 
cluster. This induces a very high correlation between active links which is not 
capture by the pair approximation. Parameters: N = 10 5 , (k) = 4. 

Accepting that the actual dynamical densities of higher-order 
moments can be replaced by their static expectation values, 
leaves us with the task of capturing the corresponding slow 
manifolds in a suitable functional form. Above, we derived 
such a functional form based on the assumption b), the absence 
of longer-ranged correlations. We can test this assumption by 
comparing the numbers of triplets observed in simulations to 
the expected values for uncorrected active links. This compar- 
ison, shown in Fig. |5j indicates that the expectation for ABB- 
triplets is almost correct, while the error in the estimation of 
ABA-triplets diverges as the system approaches the fragmenta- 
tion point. 

An intuitive explanation of the failure of the pair-approximation 
is shown in the inset of Fig. [5] The sketch shows a represen- 
tation of a typical configuration close to fragmentation. The 



6 




< 

r- 00 

E < 




p=0.43 



p=0 



—■—agent-based simulation 
- o - pair approximation 



1.0E-11. 



m(A-neighbors) 



10 



Figure 6: (Color online) Emergence of ABA-correlations close to fragmen- 
tation. Shown is T™ gA , the fraction of B-nodes with m A-neighbors. Av- 
erages from agent-based simulations are compared with the expectation of 
an Erdos-Renyi random graph without any second neighbor correlations (see 
|Appendix F) . Close to the fragmentation transition, the A-neighbor distribu- 
tion of ABA-triplets deviate from the pair approximation. Parameters: N = 10 5 , 
(k) = 4. 



nodes have sorted into two large clusters, connected by a few 
remaining links. On those links occasionally opinion adoption 
events take place which introduce some "wrong" nodes into the 
clusters and thus create many active links. The majority of ac- 
tive links is thus located on few nodes. This creates both a dis- 
proportionately large number of ABA-triplets and constitutes 
a strong three-node correlation that is not captured by the pair 
approximation. 

The intuitive explanation above can be quantified by a nu- 
merical test shown in Fig. [6] The results confirm that close 
to fragmentation most ABA-triplets occur on B-nodes having 
many A-neighbors. 

3.3. Better homogeneous approximations 

The reasoning presented above identifies the actual closure 
approximation, essentially assuming the absence of longer-ranged 
correlations as the reason for the failure of the pair approxi- 
mation close to the fragmentation transition. Let us therefore 
discuss ways in which the approximation can be improved. 

In principle every moment expansion should converge to 
the correct result if the order of the approximation is increased. 
Clearly despite its shortcoming the pair approximation is much 
better than the zeroth-order node approximation that ignores 
all, even link level, correlations and assumes that the network 
is well-mixed in terms of node states 11411 . This is anal ogou s 
to the molecular field approximation of the Ising model 1105 1. 
The first-order approximation we used above is called the pair 
approximation IU3Ul5l. ll which accounts for 

nearest-neighbor correlations but neglects higher order ones. 
This is analogous to the Bethe-Peierls approximation l62l l63l 



10514 10711 in statistical physics. When the density of cycles is 
non-negligible, i.e. when the network has high clustering, the 
pair approximation is extended in order to account for the cyclic 
mot ifs, c orresponding to Bethe-Kirkwood type approximations 
l67l Il08ll . Approximations that make the closure at high er or - 
ders are analogous to high order Kikuchi approximations Il09ll . 

Increasing the order of the approximation is expected to 
yield better results Il5l 1 64 16511 . but convergence to the cor- 
rect solution is not guaranteed to be fast or uniform. More- 
over, increasing the order of the expansion creates a number of 
technical problems. First, the number of subgraphs increases 
very quickly with the order of the expansion. For instance, a 
third-order approximation to the adaptive voter model already 
consists of 29 rate equations and 48 estimated fourth-order mo- 
ments. Second, uniquely enumerating the subgraphs and com- 
puting the correct prefactors that arise from symmetries in not 
completely trivial. Third, and perhaps most interestingly there 
are different mutually inconsistent possibilities for closing ex- 



pansions beyond the pair level (see Appendix C I. A criterion 
on which closure should be used is an important open mathe- 
matical problem. 

In the context of the adaptive voter model a higher order 
closure has been used by Kimura and Hayakawa 11511 . and for 
the specific model studied here two different higher order clo- 



sures are derived in Appendix B and Appendix C 



The performance of higher level-closures is shown in Fig. [3] 
Although the triplet-level closures perform better than the pair- 
level closure, the prediction is still very bad close to the bifur- 
cation point. We can explain this result by considering Fig. [6] 
again. In the triplet-level closure we have to estimate the den- 
sity of four-node subgraphs. In this estimation we use the as- 
sumption that the four node subgraphs are uncorrected. How- 
ever, from the numerical results we know that many active links 
connect to nodes that have ten or more such links, which im- 
plies also a high correlation at the four-node-level. 

The reasoning above suggests that the order of the approx- 
imation will have to raised beyond the mean degree of the sys- 
tem to achieve a faithful result. Because of the technical diffi- 
culties described above this is clearly infeasible. However, note 
that by raising the expansion to this point we would be captur- 
ing much information that is clearly not important. Considering 
that the number of subgraphs rises combinatorially with the or- 
der of the expansion, say tenth-order expansion would include 
an enormous number of subgraphs including exceedingly rare 
ones, which clearly cannot be of importance. Consider further- 
more that the tenth-order closure would also comprise 1 1 -node 
chains, and thus captures correlations that are longer than the 
diameter of networks in reasonable simulations. This suggests, 
that much a better performance is achieved more cheaply if a 
tailored motif-basis is used that does not cover whole orders 
but selectively contains only those subgraphs that are otherwise 
hard to estimate - an idea to which we return in Sec. [5] 

A promising alternative approach is to use a relatively low 
order moment expansion, but use a more intelligent closure. For 
instance, Gross and Kevre kidis JHill implements the approach 
of equation-free modeling ll loll to extract a proper closure term 
for an epidemic model automatically from very short bursts of 
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simulation runs. This enabled a semi-analytical investigation 
where continuation software was used to explore the dynamics 
of the system. 

Another approach proposed in a recent paper ll 1 ill is to 
generate closures from a maximum entropy principle. This ap- 
proach thus solves at least the problem of non-uniqueness of 
higher-order closures. However, in many cases the approach 
provides only implicit equations for the closure that do not seem 
to have a closed-form solution. This can be seen as an indi- 
cation that explicit fully-consistent closure approximations for 
moment-expansions beyond the pair level might not exist at all. 

4. HETEROGENEOUS APPROXIMATIONS 

Presently it is widely believed that quite universally better 
results can be obtained by heterogeneous approximations that 
capture information on the degree of the nodes. Indeed, such 
approaches hav e yielded an improvement in several example 
systems QJMI^flOOll. 

In this section, we investigate two prominent heterogeneous 
moment-closure approximations. In the heterogeneous pair ap- 
proximation 19811 . links are grouped according to the state and 
the degree of the nodes at their en ds. In the active neighborhood 
approximation 123 Mfiooll 1 1211 . nodes are placed in compart- 
ments according to their state, degree and number of neighbors 
in a given state. 

Although the heterogeneous approaches can capture effects 
resulting from the heterogeneity of the degree distribution, they 
do not specifically address the complications identified above. 
Here, we test the performance of these approaches for the voter 
model, which reveals that they do not perform better than the 
homogeneous approximations, in this context. 

4.1. Heterogeneous Pair Approximation 

The heterogeneous pair approximation is based on writing 
a set of coupled rate equations for the density of active links 
[AE\kji' between a node of degree k and a node of degree k' . 
In networks with narrow degree distribution we expect these 
densities to be independent of k and k', whereas the same is not 
true for networks with broad degree distribution l98ll . Here we 
follow an approach which is an extension of the one developed 
in J80[ 98 1 for the case of adaptive networks. We consider the 



n = 6 active links 



direct node update rule, since the derivation is easier in this 
case. 

We start by writing the active link density as [AB]^ - 
[A k B k >] + [B k A k >], where, for instance, [A k B k >] denotes the den- 
sity of links connecting a node of state A and degree k with a 
node of state B and degree k' . Assuming a node with state A 
(node i) is chosen in an update event, then 
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Figure 7: (Color online) Illustration of three update events in the direct voter 
dynamics that lead to a change in the density of active links [A9B3] connecting 
nodes of degree k = 9 and k! = 3, when a node i of degree k = 9 and state A 
is chosen. Initially (left), the number of neighbors of degree kf = 3 is N3 = 4, 
from which «3 = 3 are in the opposite state B, and the total number of active 
links is n = 6. After the update (right), some links change its type. At the 
bottom of each panel are indicated the transitions in link type that involve an 
A9B3-link, and the associated changes in the density [A9.B3]. (a) With proba- 
bility n(\ — p)/k node i copies the state of a randomly chosen B-neighbor, thus 
links attached to i change from active to inert and vice-versa, (b) With proba- 
bility n^p /k an active link connected to one of the neighbors of degree 4 (node 
j is this example) is chosen and rewired to a node a of class (A, 8). (c) With 
probability 03 p/k an active link of type A9B3 is chosen at random and rewired 
to a node a of class (A, 9). We note that this figure is an illustration of only 
some of the terms in Eq.{9). 
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With probability [A;], node i belongs to class (A,/). The 
product M(N\,..., Nj\ I) \\ k m= \ B(n m ; N m ) expresses the proba- 
bility that the configuration around node i consists of N m links 
to neighbors of the degree class m{m- l,..,k, with k the maxi- 
mum degree) and n m of these neighbors have the opposite state 
B («,„ = 0, ..,N m ). Here B{n m ;N m ) stands for the probability 
that n m of the N m links to neighbors of class m are active. 

We distinguish again between direct and indirect changes 
in [A k B k >]. A direct change takes place when node i is in either 
class Aj;/ or A*, giving the first two terms inside the brackets 
of Eq. (0, respectively. Node i adopts state B when it copies 
the state of a randomly chosen B -neighbor, which happens with 

probability (1 - p)n/k, where n = Y^ m =\ n ™ ^ s ^ e num ber of 
active links. In these events, the corresponding changes in the 
density [A k B k ,] are A[A k B k ,] = (N k - n k )/N and A[A k B k >] = 
-n k > IN respectively (see Fig.[7}a). 

An indirect change occurs due to an update on a neighbor- 
ing node. The third term inside the brackets of Eq. (0 corre- 
sponds to the rewiring of an active link connected to a neighbor 
j of class (B, k') (with probability pn k >/k), that results in the loss 
of an A k B k > link. 

Other indirect changes take place when node i is in a generic 
class A/, and one of its links to a neighbor j is rewired, affecting 
the class of the links to the node j, and the class of a-b links, 
where a is the node that receives the rewired link and node b is a 
neighbor of node a (see Figs.[7rb and c). In Fig.|7}b we describe 
the situation in which node j is in class (B, k' +1) (with prob- 
ability n k >+i/k). Given that node j loses one link, it changes to 
class (B,k'), thus there is a gain of N(A k \B k - + iA k ) links, repre- 
sented in the fourth term of Eq. (0. The fifth term (see Fig.|7]-c) 
corresponds to a loss in a similar update, when node j is in class 

Finally, the last gain and loss terms belong to the case where 
any of the active links of node i is rewired (with probability 
pn/k) to a node a in class (A,k - 1) (see Fig.[7]-b), or in class 
(A,k) (see Fig.[7]-c) respectively. Given that the link is rewired 
to an A-node chosen at random, the probabilities for these events 
are [A^_i]/[A] and [A,t]/[A], respectively. In the former event, 
the N{B k i\A k -\) links of type A k -iB k > attached to node a change 
to type A k B k >, while in the latter event the N(B k >\A k ) links of 
type A k B k i attached to node a change to type A k+ \B k i. 

Given that [A k B k f] may also change when a B-node is cho- 
sen, the evolution of [A k B k >] is given by 



d[A k B k ,} d[A k B t ] 



dt 



di 



d[A k B k 



dt 



The second term on the right hand side can be obtained from 
Eq. by interchanging A and k by B and k', respectively. By 
carrying out the summations, we arrive at the rate equation for 
the evolution of [AB] k # (see Appendix G for the derivation) 
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(10) 

where Q k = kP k /(k) is the excess degree distribution, {A k B\ = 
Yjj =l [A k B,]/l, {AB} k = {A k B} + {AB k }, [AB] k = ^([A^,] + 
[B k A,]),^{AB} = ^{A k B}. 
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Figure 8: (Color online) Performance of heterogeneous pair approximation in 
comparison to homogeneous pair approximation and agent-based simulations 
for the direct node update rule. Parameters: N = 10 5 , (k) = 4. 

Equation ( ITOb together with the consistency conditions [AB] k 
EjLitABkz and {AB} k = J^ =1 [AB] kJ /l form a closed system of 
coupled ordinary differential equations. Since the system is too 
complex to solve directly, we obtain the stationary solution by 
numerical integration starting from equiprobable [A]o = [B]o = 
1 /2 initial states in a random graph with P k = e~^ k '(k) k /k\. 

In Fig.[8]we plot the global stationary density of active links 

[AB] = h Y?k=\ [AB] k as a function of rewiring rate p, and com- 
pare it with results from agent-based simulations. The hetero- 
geneous pair approximation is in good agreement with simula- 
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tions for low p, but discrepancies become very large as p in- 
creases. The overall performance is surprisingly even worse 
than the homogeneous pair approximation. This might be due 
to the accruing of discrepancies in individual terms [A k B k f]. 
While the heterogeneous approximation certainly provides a 
more accurate description of networks with wide degree dis- 
tribution, it does not suitably capture the correlations arising in 
the fragmentation transition. 

4.2. Active Neighborhood Approach 

Recently, an alternative heterogeneous moment-closure ap- 
proximation, the active neighborhood approach |23, 9^], was 
proposed to study the dynamics of the SIS model on adaptive 
networks 11911 . Here, nodes are grouped by their compartment, 
defined according to their state, total degree and the number 
of active links. Therefore, not only the heterogeneity of the 
network is taken into account, but also the state correlations be- 
tween nearest neighbors and associated heterogeneities. In this 
formalism, there is no need of estimating the neighborhood of a 
node, because this information is already contained in its class. 

The active neigh borhood approa ch has been applied to othe r 
epidemics systems 

[[MEHEi!, Glauber dynamics JlOoTl . 
and a voter-like model where the rewiring is state independent 
lfl7ll . The approximation was found to reproduce the time evo- 
lution of both the states and the structure of the network with 
remarkable accuracy. A moment-generating function approach 
has been applied to mitigate the computational cost of the nu- 
merical integration |7(i 71]. 

We now follow the active neighborhood approach for the 
adaptive voter model. We place nodes with state A (B), degree 
k, and n (n = Q,..,k) neighbors in the opposite state B (A), 
into the compartment labeled as [A, k, n] ([B, k, n]). For reasons 
of simplicity, we assume that the time is continuous, thus that 
opinion adoption and rewiring processes take place in parallel. 
Every node in the network transmits its state to its neighbors at 
rate B, and rewires the connection from each neighbor in the op- 
posite state to a random node with the same state at rate y. That 
is, in a small time interval dt all links are updated with the same 
probability (B + y)dt. This "link homogeneous" dynamics is 
equivalent to the link update dynamics, in which links are cho- 
sen and updated with probability l/L, where L is the number of 
links in the network. Therefore, stationary states obtained from 
numerical simulations of both dynamics are similar, as shown 
in FigOS 

The evolution of A^„ is governed by the rate equation, 
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with the zeroth-order moments 
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These moments are related to the moments we defined in Sec. [3] 
by A = [A], A A = 2[AA], A B = [AB], A AB = [AAB] and Abb = 
[AB] + 2[BAB]. 
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Figure 9: Schematic representation of the possible update events in node states 
(a), (b) and (c) and links (d), (e) and (f), for the active neighborhood approach 
to the voter dynamics. Open and filled circles represent nodes in state A and B, 
respectively. 

In Fig. [9] we illustrate the six possible transitions of nodes 
from compartment [A, k, n] to other compartments (we denote 
the reference node in compartment [A, k, n] as node i), which 
correspond to the six loss terms in brackets of Eq. dTTb . The first 
of these describes the transition of node i from compartment 
[A, k, n] to compartment [B, k,k - n] at rate Bn, when it adopts 
state B from an active neighbor (see Fig.|9]-a). The second loss 
term describes the change of one of the k - n A-neighbors of 
node i to B that happens at rate BA A b/A a , where A A b/A a is the 
estimated number of the B-neighbors (see Fig.|9]-b). This yields 
the transition of ; to [A, k, n + 1]. The third term is analogous to 
the second term, but with the change B — > A of one of the « B- 
neighbors of node i at rate BB AA /B A (see Fig. |9}c), that brings 
i to compartment [A,k,n - 1]. The fourth term represents the 



10 



replacement of a B -neighbor of node i by an A-node at rewiring 
rate yn (see Fig.[9}d), thus node i moves to [A,k,n - 1]. Node 
i gains a link coming from an A-node due to a rewiring event 
which occurs at rate yAg/A (see Fig.|9}e). Node i switches ac- 
cordingly to [A, k + l,n], represented by the fifth term. Finally, 
node i switches to the compartment [A, k—\,n— 1] when it loses 
a link due to the disconnection of one of its B-neighbors at rate 
yn (see Fig.|9}f). The gain terms can be explained analogously. 
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Figure 10: (Color online) Performance of active neighborhood and agent-based 
simulations with the link update and parallel update rules. To make agent- 
based simulations compatible with the parallel update mentioned earlier, we 
used the following algorithm: In a time interval dt = 0.01, every node and link 
of the network is selected. Each node i with state A (B) changes to B (A) with 
probability pndt, where n is the number of neighbors of r' in state B (A). Also, 
each link i-j is removed with probability 2ydt and replaced either by a link 
i-k with probability 1 /2 or by a link j-k with the complementary probability 
1/2, where node k is randomly chosen within those nodes with state A (B). 
Parameters: p = 0.01, y = Pp/q, N = 10 s , (k) = 4. 

We obtain the equation for the density [B, k, n] by exchang- 
ing A and B in Eq. (fTTT) using the symmetry of the model. This 
closes the system of equations. Numerical integration of the 
closed system of equations by standard numerical integration 
algorithms gives the values of the fractions A^„ for a given 
time, and therefore, it allows one to obtain the time evolution of 
macroscopic variables, such as the densities of active links. We 
numerically solve Eq. (fTTb with initial conditions 

A M (0) = A P k 



'k\ )(l-Ao)"A*-'« 



Bjt»(0) 



B P k { n jA n (l-A ) 

(k)/ 



k-n 



(15) 



where Aq - Bq — 1/2 and P k - e~^ '(k) /kl, and determine the 
asymptotic values of the density of AB-pairs Ag = Yik,n n ^k,n 
for different values of the ratio between the rewiring and state 
adoption dynamics y/B = p/(l — p), where p is the rewiring 
probability. 

Results from the active neighborhood approximation are 
compared with agent-based simulations in Fig. [10] The agree- 



ment between the analytical approach and simulations is good 
for small values of p, but discrepancy increases with increas- 
ing p, such that also the active neighborhood approach fails to 
capture the fragmentation transition faithfully. 

5. ACTIVE MOTIF APPROACH 

In conventional moment expansions of previous sections, 
moments are taken as densities of regular subgraphs, where 
subgraphs were characterized by a given number of links and 
prescribed node states, and degrees in case of heterogeneous 
moments. While such basis provide reasonable general pur- 
pose approaches, they do not take into account the specific dy- 
namics of the system. The considerations presented in Sec. [3] 
and the failure of the heterogeneous approximations in Sec. |4] 
convey a clear message: To capture the fragmentation transi- 
tion faithfully it is essential to capture the very heterogeneous 
distribution of active links that appears close to the fragmen- 
tation transition. Even the very complex and sophisticated ac- 
tive neighborhood approximation is in essence only a first order 
approximation and thus fails to pick up the correlations in the 
active links. 

We can conclude that capturing the fragmentation transition 
faithfully requires tracking subgraphs of an order roughly up to 
the mean degree of the network. While the task of tracking all 
such subgraphs would be of enormous difficulty, it is greatly 
simplified, by tailoring the subgraph basis to the problem by 
using only those subgraphs that capture much information on 
the specific system. Our analysis above has shown that prop- 
erties such as the density of ABB-triplets and even the degree 
distribution conforms very well to statistical expectations. By 
contrast the number of ABA-triplets and larger subgraphs com- 
prising a number of active links attached to the same node defies 
statistical expectations close to the fragmentation point. 

The reasoning above suggests that we should use a basis 
consisting of subgraphs that contain different numbers of ac- 
tive links attached to the same node. Two such active motif 
bases were proposed in Bohme and Gross B87I1 . In application 
to the adaptive voter model, it was shown that both basis al- 
lowed a precise prediction of the transition point (87]]. The ap- 
proach was subsequently extended to multi-state voter models 
1 18], where it likewise yielded good results. In the following, 
we briefly explain the approach and illustrate it by application 
to the adaptive voter model. Going beyond the previous works 
we extend this approach to the estimation of active link den- 
sities, which allows a direct comparison with the approaches 
discussed above. 

For computing the fragmentation point p* we consider the 
situation where two communities holding opposite opinions have 
formed that are only connected by few active links. In analogy 
to the approaches discussed so far, considering the possible up- 
dates affecting subgraphs in the basis we derive a system of 
differential equations, governing the evolution of the subgraphs 
in time. However, because we are only concerned with sub- 
graphs containing active links and such links are rare close to 
the fragmentation point, we arrive at a linear system of equa- 
tions. The time evolution is thus fully captured by the eigenval- 
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Figure 1 1 : (Illustration of the evolution of active links in a degree regular net- 
work with degree k = 3 and link update rule. Shown is the network in the 
neighborhood of an active link connecting components of different opinions. 
Arrows correspond to dynamical updates and are labeled with the correspond- 
ing transition rate. Depending on the parameters the updates lead to prolifera- 
tion or decline of active motifs containing one active link (encircled dotted) or 
two active links (encircled dashed). 



ues of the corresponding Jacobian matrix. If all eigenvalues of 
the Jacobian are negative the fragmented state is stable and the 
remaining active motifs will disappear over time. By contrast, 
if the Jacobian has an eigenvalue with positive real part, then 
the fragmented state is unstable and the network will remain 
connected. The transition point is thus marked by A(p, (k)) = 0, 
where A(p, (k)) is the leading eigenvalue. 

To illustrate the approach in more detail let us assume that 
the network is degree-regular, such that every node has the 
same degree. This assumption can be justified by our earlier 
observation that the degree distribution stays narrow for all val- 
ues of p. For illustration let us further consider the specific case 
of k = 3. Here, the dynamics of active motifs is illustrated in 
Fig-Qj] We start by considering a single active link (which we 
call a 1-fan). In the next update, the link will be rewired with 
probability p deactivating the motif. With probability 1-p one 
of the nodes connected by this link adopts the other's state. In 
the adoption event, the original active link becomes inert, but 
the k — 1 other connections of the adopting agent become ac- 
tive. This leads to a k - 1-fan, a motif of k - 1 active links, 
connected by a base node. If the next update, which affects the 
k - 1-fan, is a rewiring event (probability p) the motif is turned 
into a £-2-fan. If the update is an adoption event, then either the 
base node changes its opinion or one of the fringe nodes adopts 
the base node's opinion, giving rise to a 1-fan or to two fans, 
one containing k - 2 and the other one k - 1 active links. In the 
case of link update both processes occur with equal probability 
(l~P)/2. 

For k — 3, we obtain a closed system of two differential 
equations for the densities \q] of g-fans: 



d{\] 
dt 

d{2] 
dt 



-{l} + 2{2}, 

-2{2} + (l-p){l} + (l-,p){2}. 
The corresponding Jacobian is 



-1 
l-p 



2 

-l-p 



(16) 



(17) 



Figure 12: Illustration of the evolution of active links in a degree regular net- 
work with degree k = 3 and link update rule. Updates which lead to transitions 
between different motifs are depicted as in Fig. 1111 Now the transition rates 
depend on the probability tr that a newly created fan is active. 



and the condition A(p, 3) = yields p* = 1/3 for the transition 
point. The described procedure can be generalized to arbitrary 
k. For k — 4 (the degree considered here), the predicted tran- 
sition point is in good agreement with the value (p* w= 0.445) 
from agent-based simulations which violates the assumption of 
degree regularity. 

In order to account for a degree heterogeneous network, a 
basis set of {m, /[-spiders is used: a spider motif consists of 
one central base node which is connected to m nodes of its own 
opinion and / nodes of opposing opinion. The dynamical evolu- 

and 



tion equation for spider motifs is provided in Appendix I 



leads to a very close approximation of the true transition point. 

In the estimation above for the calculation of the transition 
point, we assumed that in a g-fan motif, all neighbors of the 
fringe nodes (except for the base node) hold the same opinion 
as the fringe nodes. This assumption is valid for vanishing ac- 
tive link density at the symmetric state cr = [AB] / {(k)[A]) — > 0. 
Now we consider the case p < p* , where there is a finite density 
of active links. In our equations we therefore have to include 
the possibility that a fringe node already holds outer active links 
(apart from the one connecting to the base node), which become 
inert when the fringe node adopts the state of the base node. By 
utilizing the observation that active links tend to gather, rather 
than distribute homogeneously over the whole system, we as- 
sume that whenever a new k - 1-fan is created, this fan is either 
active, with probability (1 - cr), or inactive with probability cr. 

In Fig. [12] an example for the degree regular case (k = 3) 
is illustrated, where we include the active link density in the 
transition probabilities. As before, this can be summarized in a 
system of evolution equations for the motif densities 

^ = -il} + 2{2} 
dt 

^ = -2{2} + (l-p)(l-<r)({l} + {2}). (18) 
dt 

Note that for cr — we recover Eq. Q~6] 

The corresponding Jacobian now depends on p and cr. Solv- 
ing A(p, cr) = yields 



oip) = 



4(1 -2p) -(l-p) 2 
8(1 -p)- (l-p) 2 



(19) 
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Figure 13: (Color online) Performance of active motif approach, compared to 
agent-based simulations for the link update rule. Parameters: N = 10 5 , (k) = 4. 



In Fig.Q~3]the resulting curve [AB] = cr(k)/2 from the de- 
gree regular approach is shown for {k} = 4. Comparison to sim- 
ulation results shows that, as expected, the approximation of the 
active link density works well in the vicinity of the fragmenta- 
tion threshold, whereas for small rewiring rates it becomes very 
bad as active links are increasingly well mixed. 

6. SUMMARY AND DISCUSSION 

In this paper we investigated the performance of moment- 
closure approximations for discrete adaptive networks. In par- 
ticular we used the adaptive voter model as a benchmark model 
to assess different approaches. The comparison with agent- 
based simulations revealed that both homogeneous and hetero- 
geneous moment-closure approximations capture qualitative prop- 
erties of the fragmentation transition, but fail to provide good 
quantitative estimates close to the fragmentation point. Re- 
markably, even very sophisticated heterogeneous approaches 
can produce results that are worse than those from simple ho- 
mogeneous schemes. Finally, we identified the active motif ap- 
proximations as a class of approximations that were able to cap- 
ture the behavior close to fragmentation point quantitatively. 

The present results are likely to hold in a much larger class 
of models. In the adaptive voter model conventional approaches 
fail close to the fragmentation point because some specific cor- 
relations appear. These correlations can be generally expected 
to arise in fragmentation transitions regardless of the specific 
model under consideration and should th us occur in a large 
variety of models E H [13 ES H [TTWTsll . We fur- 



ther expect that similar correlations could arise in networks that 
self-organize into specific topologies such as leader-follower 
networks, approximately bipartite nets, or c omplex top ologies 
with other long -ranged state correlations 1301 1 1 19lll20ll . 

Perhaps the main message from the current work is that 
even the evolution of problematic models can be captured if 



an expansion is used that is tailored specifically to the system at 
hand. In this paper we have used extensive numerical and an- 
alytical investigations to identify the problematic correlations. 
However, in retrospect just considering a sketch of the situation 
close to fragmentation, such as the inset in Fig. [5] could have 
pointed us to these correlations and hence to a suitable approx- 
imation scheme. 

Anticipating the structures that are likely to emerge promi- 
nently in a given model should generally allow to identify a 
suitable approximation scheme. Using the spider or fan motifs 
of the active motif approximation will improve predictions in 
models close to fragmentation or related de-mixing transitions. 
By contrast, including such motifs in the subgraph basis of an 
approximation scheme could be cumbersome and even have an 
adverse effect in models that remain well-mixed. Models that 
are prone to evolve degree-state correlations or stro ng cluster - 
ing w ill re quire specific approaches such as 1 64 , 65 , lOll Il2ll - 
12411 (see 110211 for a review). By contrast, in models with 



strong random rewiring and sufficiently low degree, small cy- 
cles should be rare and thus subgraphs containing cycles can 
(and should) be ignored when selecting the approximation scheme. 
Clearly, for all models that tend to evolve very heterogeneous 
degree distributions, heterogeneous approximations such as the 
heterogeneous pair approximation or the active neighborhood 
approach are required. However, even in the case when degree 
distributions become broad but not exceedingly broad, such as 
in Gross et al. 11911 . it may be worth to consider homogeneous 
approximations as they may still provide relatively good results, 
at a significantly lower cost than the heterogeneous approxima- 
tions. 

Finally, we note even for the deceptively simple adaptive 
voter model, we have not yet identified an approximation that 
works well over the whole parameter range. While the active 
motif approximation yields faithful results in the ordered states 
close to fragmentation it fails in well-mixed systems. Con- 
versely, all other approaches studied here work reasonably well 
when far from fragmentation, but fail at the fragmentation point. 
In the future a scheme that works over the whole range of rewiring 
rates may be found, either as a reasonable interpolation between 
the existing approaches, or by the informed design of a suitable 
approximation. We hope that the information gathered in the 
present survey will contribute to reaching this goal. 
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Appendix A. The origin of second-order terms in the first- 
order moment expansion 

Here, we derive the triplet density terms in the moment ex- 
pansion Eq. Q]from local selection events and combinatorics. 
We illustrate it on Q(A\BA) which denotes the number of ad- 
ditional A-neighbors of the B-end of a randomly selected AB- 
link. 
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The quantity Q(A\BA) can be written as Q(A\BA) = P(A\BA) 
(qs), where P(A\BA) denotes the probability that a random neigh- 
bor of the B-end of a randomly selected AB-link has state A and 
(q B ) denotes the mean excess degree, as derived in the main 
text. The probability P(A\BA) is expressed as a ratio of the cor- 
responding triplet densities, i.e. P(A\BA) = 2[ABA]/(2[ABA] + 
[ABB]), where [ABA] = N ABA /N (N ABA is the number of ABA- 
triplets) and analogously [ABB] = N AB b/N. 

Let ki and «, be the number of all (A and B) neighbors 
and A-neighbors of a B-node selected at random (node i) re- 
spectively. The number of triplets is obtained from a summa- 
tion over all B-nodes: N ABA = Z, e (B) n i( n i ~ l)/2 and N ABB = 
lZiE{B} n iki> where {B} is the set of B-nodes. We thus obtain 
2N A ba + N ABB = lZi£{B} n i(ki - 1). Now, we proceed with the 
summation 



i€{B) 



^ iijkj - ^ fij 

i£{B] i£{B] 

J] ki-N[AB) 

ieB 

((', j) € Edges 



= N[AB] 



kP B 

Yk- k 

< k 



- 1 



kP* 



and obtain 2[ABA] + [ABB] = 
By this, we reach 

Q(A\BA) 



[B](k B ) 

= N[AB]Y,(k - l)kP^/([B](k B }) 

k 

= N[AB](q B ) 

(2N ABA + N ABB )/N = [AB](q B ). 



2[ABA] 
[AB] 



Appendix B. Second order moment expansion for the link 
update rule 

Since the right-hand side of Eq. [T] involves second-order 
moments, the first-order expansion is not closed. We now treat 
the second-order moments as dynamical variables and derive 
the corresponding rate equations. In Fig. IB. 14l we illustrate the 
complete set of possibilities and the corresponding rates where 
ABA-triplets are created or destroyed. The second-order ex- 
pansion reads 





= o, 


> ■ 


2 




2 


[AAA] = 

dt 


■ ^ 



([AB] + 2[ABA] - [AAB]) + 

([AB] + 2[BAB] - [ABB]) + ^[AB], 



(2[ABA] + [AAB] + [ABAA] 
\-3[(B)AAA] - [AAAB] - [(A)BAA]J 
'([AAB] 



[AA][AB]\ 



2V ~- J ■ [A] r 

I- PI 



dt 



[AAB] = -^-{[ABB] + 2 [BAB] - 2 [AAB] 
+[BAAA] + [ABAB] + 2[(B)AAB] 
-[ABAA] - 2[BAAB] - 2[(A)BBA] ] j 

|(2[BAB] - 2 [AAB] + 



^ [ABA] 
dt 



+ 
1- 



( - A[ABA] + 2[ABBA] + [(A)BAA] 



-[ABAB] - 3[(B)AAA]j - 4/7 [ABA], 



(B.l) 



where [XYZW] denotes the density of chain-quadruplets con- 
stituted by a node of state X (node 1), a Y-neighbor of node 1 
(node 2), a Z-neighbor of node 2 (node 3), and a W-neighbor 
of node 3 (node 4), and [(X)TZW] denotes the density of star- 
quadruplets constituted by a node of state X at the center and its 
three neighbors of state Y, Z, and W with X, Y, Z, W e {A,B|. 

For illustration, we derive the corresponding contributions 
to d[ABA]/dt for processes (e) and (h) in Fig. IB. 141 

In the process (e), an ABA-triplet is created per each AB- 
link connected through its B-node to the B-end of an AB-link 
on which B-node adopts state A. We denote the A (B) end of a 
randomly selected AB-link as node X (Y) and a random excess 
neighbor of node Y as node Z. The expected number of AB- 
links connected through its B-node to node Y is Q(AB\BA) = 
P(AB\BA)K BA , where P(AB\BA) is the probability that node Z 
has state B and a random neighbor of node Z has state A and 
K BA is the expected number of excess triplets attached to node 
Y. 

Node Y has degree k with probability kP% /([B](k B }). As- 
suming neutral mixing by degree, node Z has degree k' with 
probability k'P t l{k). Thus, K BA = (£, (k - l)kP B k /([B](k B )))x 
(Ht (k 1 ~ ^)k'Pk'l{k)) = iq B ){q)- In the symmetric state, K BA = 
(q) 2 - 



Analogous to the expression of B(A|BA) in Appendix A 
we write the conditional probability P(AB\BA) as a fraction 
of appropriate network moments, i.e. P(AB\BA) = 2[ABBA]/ 
(2[ABBA] + [ABBB] + [ABAB] + [ABAA]). In order to approx- 
imate the denominator, we use the second-order approximation 
for chain-quadruplets, which is derived in Appendix C . Fol- 
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Figure B. 14: Second order moment expansion for d[ABA]/dt in the link update 
rule. 



lowing this approximation, 

2[ABBA] + [ABBB] + [ABAB] + [ABAA] 

[ABB]([ABB] + 2[BBB]) 2[ABA]([AAB] + 2 [BAB]) 



2[BB] 
= (q)([ABB] + 2 [ABA]) 
= (qflAB]. 



[AB] 



Thus, P(AB\BA) = 2[ABBA]/«« ? ) 2 [AB]). Since K AB = {q} 2 , we 
reach 

Q(AB\BA) = 2[ABBA]/[AB]. (B.2) 



Similarly, 
Q(AA\AB) 
Q(AB\AB) 
Q(BA\AB) 
Q(BB\AB) 



[AAAB] 
[AB] ' 

[ABAB] 
[AB] ' 
[BAAB] 
[AB] ' 

[BBAB] 
[AB] 



(B.3) 



Furthermore, in the process (h), an ABA-triplet becomes an 
AAA-triplet per every two A-neighbors of the B-end of a ran- 
domly selected AB-link. We call such subgraphs constituted 
by a node and its three neighbors as stars. We again denote 



the A (B) end of a randomly selected AB-link as node X (Y). 
We denote the expected number of the configurations where 
node Y is connected to two additional A-nodes as Q(A,A\BA) = 
P(A, A|BA)5 B , where P(A, A\BA) is the probability that two ran- 
dom neighbors of node Y both have state A, and S b is the av- 
erage number of two-combinations of excess neighbors of node 
Y. 

Node Y has degree k with probability kP\ /([B](k B )). The 
termS B is obtained from S b = Z*(* - 2 )( k ~ i)kP*/(2[B](k B )). 
In terms of statistical moments of the degree distribution, 

_ (4) - 3(k 2 B ) + 2{k B ) 
B 2[B]{k B ) 

We write the conditional probability P(A,A|BA) as a frac- 
tion of appropriate moments as before such that P(A,A\BA) = 
3[(B)AAA]/(3[(B)AAA]+2[(B)AAB] + [(B)ABBJ). The density 
[(B)AAA] is defined as [(B)AAA] = N( B )aaa/N, where N (B )aaa 
is the total number of (B)AAA-stars (central B-node, three A- 
neighbors). The densities [{B)AAB] = N {B) aabIN and [{B)ABB] ■■ 
N(B)abb/N are defined analogously. The number of stars are 
obtained from a summation over B-nodes such that N(b)aaa = 

2,e(B) n i( n i ~ !)( n i _ 2 )/ 6 ' N (B)AAB = Zj S {B) «/(«/ - l)(k ~ «,)/2, 

and N(B)abb = lZie\B} n i(ki-ni)(ki -rij- 1)/2, where kj and «; are 
the number of all neighbors and A-neighbors of node i respec- 
tively. We reach the expression 3N (B )aaa + 2N (B )aab + N (B )abb = 
ZiejB} n t(kf ~ 3fc, + 2)/2 and proceed with the summation 



J] nlk] - 3k t + 2) 



ie{B) 



^ (k 2 -3k i + 2) 
ieB 

(i, f) 6 Edges 

v^ft- 2)(k - l)kP? 
N[AB]J] 



= N[AB] 



2[B](k B ) 
(kl) - 3 * (k 2 B ) + 2{k B ) 



[B]{k B ) 



= 2N[AB]S B 



and obtain 3[(B)AAA] + 2[(B)AAB] + [(B)ABB] = [AB]S B - We 
reach 

Q(A,A\BA) = 3[(B)AAA]/[AB]. (B.4) 



Similarly, 

£(A,AAB) = 



Q(A, B\AB) = 2 
Q(B, B\AB) = 3 



[(A)BAA] 
[AB] ' 
[(A)BBA) 



[AB] ' 
KA)BBB] 
[AB] 



(B.5) 



Appendix C. Second-order moment closure approximation 

In order to close the expansion Eq. IB. II we need to express 
third-order moments in terms of lower order ones. 

We first derive the second-order approximation for the chain 
quadruplet density [ABBA]. We start with the BB-link at the 
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center, which has density [BB], and estimate the number of the 
A-nodes connected to the two ends, between which no correla- 
tion exists according to the second-order approximation. Each 
B-end has [ABB]/2[BB] A-neighbors on average, as obtained 
in Appendix A We reach the following second-order approx- 
imation: 2[ABBA] = 0.5[ABB] 2 /[BB]. We note that 2 appears 
on both sides, because we can't distinguish between the two 
B-nodes in the BB-link and the two ABB-triplets, 

We derive the remaining terms for chain quadruplets analo- 
gously and obtain 

[AAA][AAB] 



[AAAB] 



[ABAA] 



[ABAB] 



[ABBA] 



[AA] ' 
2 [ABA][AAB] 
[AB] ' 
[ABA][BAB] 
[AB] ' 
[ABB] 2 



A[BB] ■ (C1) 

We now illustrate the second-order approximation for the 
star motif density [{A)BBA], which is the density of subgraphs 
formed by an A-node in the center and its three (two B and 
one A) neighbors. We consider the star motif as an assembly 
of two triplets originating from the same end of a shared link. 
We start with locating an AB-link that appears at density [AB]. 
Each excess neighbor of the A-node has state A with probability 
[AAB]/{q)[AB] and state B with probability 2[BAB]/{q)[AB]. 
The expected number of star-quadruplets originating from one 
end of a random link is l/2((fc 3 ) - 3{k 2 ) + 2(k))/(k), where 
(k n ) is the n th moment of the degree distribution. By using 
it, we obtain 2[{A)BBA] = (k)(((k 3 ) - 3(k 2 ) + 2(k})/((k 2 } - 
(k)) 2 )(2[BAB][AAB])/[AB]. If we assume a Poissonian distri- 
bution, the second moment {k 2 ) = (k) 2 + (k) and third moment 
(k 3 ) = (A:) 3 + 3(A) 2 + (k). Thence, we reach the approximation 

[AAB][BAB] 



[(A)BBA] - 



[AB] 



However, approximations for star-quadruplet densities are 
not unique. It depends on which pair is considered to be shared 
by the two constituting triplets. Above we took the shared link 
to be an AB-link. We could also select the AA-link instead as 
the shared link which leads to a different approximation. By 
considering such alternative ways of motif construction, star 
quadruplets can be approximated as 



[(A)BAA] 



[(A)BBA] - 



[(A)BBB] - 



[AAB] 2 [AAB][AAA] 



2[AB] 
[AAB] 2 
4[AA] ' 
2[BAB] 2 
3[AB] 



2[AA] ' 
[AAB][BAB] 
[AB] ' 



(C2) 



Appendix D. Reverse node update rule 



Moment expansion equations for the reverse node update 
rule are very similar to those of the link update rule with the 
following changes in rates. 



An A-node adopts state B at rate (1 - p)[A][AB]/(k A ) and 
an AB-link is replaced by an BB-link through rewiring at rate 
p[A][AB]/(k A ). Analogously, a B-node adopts state A at rate 
(1 - p)[B][AB]/(k B ) and an AB-link is replaced by an AA-link 
through rewiring at rate p[B][AB]/(k B ). 

The degree distributions of the nodes selected at an update 
event depend on the update rule. In the link update rule, both 
of the nodes at the two ends of a selected link have degree k 
with the same probability kPkl{k). In the reverse node update 
rule, the first selected node (node X) has degree k' with proba- 
bility Py and its random neighbor (node Y) has degree k with 
probability kPkl{k). The degree distribution of node X does not 
show up in the first-order equation and the degree distribution 
of node Y is the same as in the link update rule. Therefore, the 
first-order equation for the reverse node update rule differs from 
that of the link update rule due to the changes of rates of events 
only 

d M1 n .([AB] [AB]\ 
— [A] = (l-p)\ -jtt ~ 77TT • 
dt \ (k A ) (k B ) ) 

d iAAi - a J [AB] ■ [AB]2 2[AB][BB] \ 
lAA] = {1 - p \Tk^ + 7k^[A]- (k„)[B] ) 



dt 



+l> 



[AB] 



^ <**>/' 

—[BB] = {l _ p){ m + [AE^_2[AB][AA], 
dt L l \(k B ) (k A )[B] (k A )[A] ) 

'[(kA)) 



(D.l) 



At the symmetric state [A] = [B] = 1/2, Eq. ID.ll is equiva- 
lent to Eq.|6]with the rescaled time f - (k)t. 



Appendix E. Direct node update rule 

An A-node adopts state A at rate (1 - p)[AB] / (k A ) and an 
AB-link is replaced by an AA-link through rewiring at rate 
p[AB]/{k A ). Similarly, a B-node adopts state A at rate (1 - 
p)[AB]/(k B ) and an AB-link is replaced by a BB-link at rate 
p[AB]/(k B ). 

To estimate the indirect contribution term, we use the quan- 
tity Q(A|A i B2) that represents the average number of A-neighbors 
of an A-node given that it already has a B-neighbor. Indices 1 
and 2 indicate that the A-node was chosen first and the B-node 
was chosen after that. Given that node X is chosen at random 
in the direct node update rule, it has degree k with probability 
Pk- We also know that X has a B-neighbor, thus the probability 
that each of the k- 1 remaining neighbors has state A can be es- 
timated as [AAB] I {q A )[AB]. Averaging over the entire network 
we obtain 



Q(A\A l B 2 ) = Y I (k-l)P k 



[AAB] (k A ) — 1 [AAB] 



(q A )[AB] (q A ) [AB] 



Then, the following set of equations is reached for the direct 
node update rule: 
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At the steady-state, the link density [AB] can be expressed 
in terms of triplet density in Eq. IE. II 



[AB] = 



K{k) 



([AAB] - 2[ABA]) . 



(E.2) 



However, this requires numerical values of the triplet den- 
sities that should be measured from the agent-based simula- 
tions, which is undesirable as explained in the main text. In- 
stead, we develop a first-order moment closure approximation. 
Since node X is selected without resorting to the information of 
node Y, node Y should be treated as a sample from the neigh- 
bors of node X. An alternative solution to this problem is to 
ignore the information from node Y and use a pair approxima- 
tion. Then, any neighbor of node X has state A with proba- 
bility 2[AA]/[A](&) / i. The pair approximation formulation for 
g(A|A 1 B 2 ) is 



Q(A\A X B 2 ) ^ Q{A\Ax) = JVjttf-l) 



2[AA] 
[A]{k A ) 



2{{k A )-\)[AA] 
(k A ) [A] ■ 

This is equivalent to using the pair approximation for the 
density of triplets, such as 



[AAB] 2k a 



[AA][AB] 
[A] 



Replacing this expression for [AAB] and the analogous ex- 
pressions for the other densities of triplets in Eq. IE. II we arrive 
at 
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dT [AA] 



i [B B] 



= a-p) 



[AB] [AB] 

(k B ) 



(k A ), 

([AB] | {{k B )-\)[ABf 
P) \ (k B ) [B](k B ) 2 
2((k A )-l)[AA][AB]} _ [AB] 



[A](k A ) 2 



\ +P \k A ) 



([AB] ({k A )-l)[AB] 2 
P> \ (k A ) [A](k A ) 2 
2({k B )-l)[BB][AB] } | [AB] 
[B](k B ) 2 } P (k B )- 



(E.3) 



Appendix F. Derivation of pair approximation for the frac- 
tion of active triplets 

Let's denote B™ as the fraction of B -nodes with k total (A 
and B) and m A neighbors with the normalization Yik 2m=o P" k 
I The fraction B"! is expressed as B™ = PfP(m,k)/[B], where 
Pf l[B] is the fraction of B-nodes with degree k and P(m, k) is 
the probability that m links out of k are active. For an infi- 
nite Erdos-Renyi random graph, Pf/[B] is Poisson distributed, 
i.e. Pf/[B] = {k) k e~^ jk\. If we neglect state correlations to 
second nearest-neighbors, then every link connected to a B- 
node is active with probability cr p ^ = [AB] s p ^/([B]{k)) = 
2[AB] s p ^l{k), at [B] = 1/2, where we measure the average ac- 
tive link density [AB] s p ^ at a specific p and (k). When second 
nearest-neighbor correlations are ignored, P(m, k) is a binomial 
distribution, i.e. P(m,k) = (m\(k - m)l/kl)a^ {k> (l -(T p , { k)t~ m . 
Therefore, in the uncorrelated infinite-size Erdos-Renyi case 
B™ obeys 



b: 



m\(k-m)\e- {k) {k) k 



(ft!) 



k—fl 



(F.l) 



The quantity T\\ A is the fraction of ABA-triplets that have 
a B-node with m A-neighbors. By definition, 



T ABA = Y, ll2m{m - l)B "- 



(F.2) 



k>w 



Appendix G. Derivation of the heterogeneous pair approx- 
imation 

Here, we first derive the rate equation for the average change 
in the density of active links [A k B k >] when a node with state A 
is chosen. We rewrite Eq. (0 as 



d[A k B k 



dt 
where 



[A]l 



= Z -T Z - Z M(M ' N » l) ^ • - 

A l=\ M=0 Ni=0 

(G.l) 



N\ k 
S{N\,..,N T ) = Z-Z Yl B(nm ' Nm) 



n\ =0 »t=0 m=l 



a-p) 



N k n k ~n 2 k + (N k - n k ) ^ n m \di,k 
nj, + n k> ^ »mW - pn k ,5i tk 



+ P 



pn k , +1 N(A k \B k , +l A,) - p n k ,N{A k \B k ,Ai) 
"[A] M iV(B t ,|An) [A] k N(B k ,\A k ) 



[A] 



[A] 



: Z n < 

m= 1 



(G.2) 



We have also replaced the number of active links n around 
the chosen node by 2f„=i To carry out the summations in 
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Eqs. ( IG.lb and ( IG.2I ). we assume that the network has no degree 
correlations, thus the probability that a given node has a neigh- 
bor of degree m is Q„, = mP,„/(k). Then, the probabilities M 
and B become the multinomial and binomial distributions, re- 
spectively, 



M(N u ...,N I ;l;Qu...,Q^) = 



I MLJVj, 

lo 



when Tf m =\ N "> 
otherwise, 



and 



B(n m ; N,„) 



N m \q n ^{l-q m ) N --"- 
n m \(N m -n m )\ 



(G.3) 



(G.4) 



Here, q m \\ = P(B\m;A,l) ^ [AiB m ]/lQ ln [A]i is the condi- 
tional probability that a neighbor of a node in class (A, /) that 
has degree m is in state B. This probability is estimated as 
the ratio N(A, I — > B, m)/N(A, I —> m) between the number of 
links N(A, I -> B,m) - [A t B m ]N from nodes of class (A, 1) to 
nodes of class (B, m), and the number of links N(A, I — » m) = 
[A]iNlQ,„ from nodes of class (A, I) to nodes of degree m and 
state A or B. The multiple summation in Eq. AG. 21) . weighted by 
the product of the binomials, leads to the first and second mo- 
ments, <n ffl ) = £,„ B(n m ; N m )n m and {n 2 m ) = £ m B(n,„; N m )n 2 m , 
respectively, obtaining 



S(N 1 ,..,N l ) = (\~p) 



N k {n k ) - (n\) + (N k - <«t» ^<n m ) 



(n 2 k ,) + {n k ,)^{n m } 



m±k' 



8u 



p{n k >)6 Uk + p(n k , +l )N(A k \B k , + l A,) 
p{n k ,)N{A k \B k ,A,) 
~[A] k ^N(B t \A k ^) [A] k N(B k ,\A k ) 



[A] 



[A] 



= (1 - /?)^|/(^|; - X)Nk + (1 - q k \i)N k q m \iN m 

m 

x 6w 



- (1 - p) 



(1 - q k >\i)q k >\iN k , + q k > V N k > ^ q m \lN, 



pq k >\iN k >5i ik + pN(A k \B k , +l A,)q t+lv N k >+i 
pN(A k \B t A,)q k , v N k > 



[A] k ^N(B k ,\A k ^) [A] k N(B k ,\A k ) 



[A] 



[A] 



q m \iN m , 

m= i 

(G.5) 



where we have used the expression for the moments (n m ) = 
q m \\N m and (n 2 n ) = q mV N m + q 2 n]l N m (N m - 1) of the binomials 



defined in Eq. ( IG.4t . Now, inserting expression ( IG.5l l for S in 
Eq. dG.U we obtain 



d[A k B k 



dt 



=i l f{«-» 

i=i 



(q k \l - l)q k ,i{N k ) 



h(l - q k \i)Yq m \i(JV k N,„) 



- (1 - p) 



(1 - qk'\i)q k '\i{N k >) + q k >\i ^ q m \i{N k >N m ) 



x 



+ P 



pq k '\i{N k >)Si,k + pN{A k \B k , +x A,)q k , +lv {Nk>+\) 
P N(A k \B t A,)q k , v (N k .) 
' [Ah^NiB^A^) [A] k N(B k , \A k ) ' 



[A] 



[A] 



X Y^qnAliNm) 



(G.6) 



Then, using the pair approximation to estimate the num- 
ber of nodes in class (B, k') connected to a node in class (A, k) 
as N(B k ,\A k ) ^ kQ k tq k >\ k and the additional number of nodes in 
class (A, k) attached to the B-node of an A/B^-link as N(A k \B k >Ai) 
N(A k \B k ,) - (k' - \)Q k r w , with = P(A\k;B,k>) - [A*%]/ 
(fc'Qjtt^'X we arrive to 



d[A k B k 



di 



^[AUd-pXl-D^q^ 



+ P 



i=\ 

X (1 - q k \i)Qkdi,k> ~ qk>\iQk'5i,k 

qk>\iQk'di,k + pk' r k \ k , + iq k , + i\tQ k Q k >+i V 
p(k! - \)r k \ k ,q kl \]Q k Q kl 

(k- l)q k >\ k -\Q k >[A] k -\ kq k ,\ k Q k ,[A] k 



[A] 

I 

q m \iQ n , 



[A] 



(G.7) 



where we have used the following expressions for the mo- 
ments of the multinomial distribution M, defined in Eq. dG.31 1: 



(N k >N m ) 



i i 

J] M{Nu~,N t ,r)Ne = Q k >l 

N, =0 N T =0 
I I 

2 ...J] M{N U :,NfJ)N k ,N m 



N, =0 Nt=0 



Qk'QmlQ - 1) fork' it m ; 
Qk'l + QpQ-l) for£'=m. 



(G.8) 



Using in Eq. ( lG.7t the expression for the probabilities q k ,\\ 
and r k \ k ,, and expressing the sum £,« q m \iQm as [A/B]/Z[A];, with 
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[A/B] = 2m=i [A-iB m ], we arrive at the expression Eq. ( IG.9 



(1-/0 
(1 - P) 



k! - 1 



[A k B k ] 



[A k ,B] 



k' ~\ k'Q k [A] k , 
k-\ [A k B k ,][A k B] [A k B t ] 



k 2 [A] k 
k' [A k B k , +l ]{AB k , +l ] 
k' + 1 [B] k , +l 
k' - 1 [A k B k ,){AB k ,] 

k> [B] k , 
[A k ^B k ,] - [A k B k ,] 



[A] 



{AB} 



kP k /{k), [A k B] = ZLMkB,,,], 



(G.9) 
{AB k ,} = 



where Q k 

ZljAiBvl/l, and {AB} = Zjj =l [A,B]/l. 

Given that [A k B k >] may also change when a B-node is cho 
sen, the evolution of [A k B k >] is given by 



d[A k B k ,} d[A k B k> ] 



dt 



di 



d[A k B k >] 



dl 



The second term on the right hand side can be obtained from 
Eq. (G.9) . by interchanging A and k by B and k' , respectively. 
Adding the two contributions leads to 



d[A k B t ] 
dt 



k-l. 



k' - 1 , 



{l-p)\Qk'—\.AB k } + Q k —j^—[A k -B] 



[AB k ]k-l [A k ,B] kf-l\ 

+ — — [A t B k ] 



[B] k k 2 [Ah k' 2 
[A k B]k-\ | [AB k> ]k'-\ 
[A] k k 2 [B] k > k' 2 

+ iVf) [AA ' ] 

k' [A k B k , +l ]{AB k , +l ] 
k> + 1 [B] k , +l 

k [A k+l B k ,]{A k+l B] 
k+l [A] k+l 
k' - 1 {AB k ,} k - 1 {A k B} 
~' [Bh + k [A] k 
[A k ^B k ,] [A k B k ^] 

[AB\ 



[A k B k ,] 



[A k B k ,] 



[A] [B] 
[A k B k ,]{AB} \ 
[A][B] y 



(G.10) 



Finally, given that [AB] k k > = [A k B k >] + [B k A k >], and using the 
symmetry between A and B states and the fact that in a time of 
order unity, a quasi-stationary state is established, in which the 
fraction of nodes in different degree classes [A] k /P k ([B] k /P k ) 
reach the value corresponding to the global density [A] {[B]), 
we reach the final equation Eq. HOi . 



Appendix H. Derivation of the homogeneous moment ex- 
pansion from active neighborhood approach 

Summing over k and n and using the constraint As = Ba, 
Eq. (fTTb leads to 

^-=0, and (H.l) 
dt 

^=B [A AB + B BA - A BB ~ B AA ] - 2yA B . (H.2) 
dt 



Equation ( IH.ll ) expresses the conservation of the global density 
of nodes in a given state, that is a well-known property of the 
voter model under link update dynamics. Equation (1H.2I ) can 
be associated to the evolution of the density of AB-pairs, by 
writing the first and second moments in terms of densities of 
pairs and triplets as we already defined after Eq. (fT4l) . 



d[AB) 
dt 



= b[[AAB] + [BBA] - 2[AB] - 2[ABA] 



- 2[BAB]\ - 2y[AB) 



(H.3) 



Eq. dH.3l > is the same as the equation derived for link update 
Eq. (Q]), showing the equivalence between parallel and link up- 
date dynamics. 

Appendix I. Active motif approach: equations for spider 
motifs 

The rate equations for spider densities [m, 1} for link update 
are given by 



d 
dt 



^-{m, 1} = - l{m, 1} + \{l + l){m - 1,/+ 1} 



+i(l -p)m{l,m} + £(l+l){m,l + l}, 



where m + 1 , and 



-{1,1} = -/{l,Z} + i(l - P ){1, l}+ f(Z+ 1} 



for m- 1 . Here we use a Poissonian degree distribution P{k) = 
e^ k \k) k jk\ with mean degree (k). In order to obtain a Jacobian 
of finite size we consider only motifs with m + l < k m!ix . 

The transition probabilities for node update rules differ from 
those for link update, depending on the degree of the chosen 
nodes. The corresponding equations for direct node update are 
given by 



— {m, I) — — l{m, 1} 
dt 

+(1 - p)(l + l){m - 1,1+ P <k) (g + l)a m ,i(g) 

g 

+p(l + \){m - 1,1 + 1}£ P {k> (g + l)B mJ (g) 
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+(1 - p)m{l, m) J] P {k) {g + \)p mJ {g) 

g 

+p(l + \){m, 1+1} J] p (k>(8 + l)awte). 

^{l,/} = -/{l,/J 

+(l-p){U}2><*>(*+Ws) 

+p(Z + 1){1, / + 1} J] P<*>(g + 1 )<*,,,(*) 

g 

+(1 -p)P (k) (l+ l)a 1 j(fi^y{x,y}, 

where a m ,/(g) = (l + m)/(l+m + g + 1) and = + + 
m + g + 1). 

The equations look similar for reverse node update. 
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